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DATA PROCESSING SYSTEM AND METHOD 

Field of the Invention 

5 The present invention relates in general to a data 

processing method and system. 

Background to the Invention 

10 In general terms, it is desired to assemble many 

small sections of raw audio and video content (i.e. sound 
clips and video clips) to form a finished audiovisual 
product, by way of an authoring process. However, in many 
environments a considerable degree of specialist knowledge 

15 and time must be invested in the authoring process in 
order to achieve a desirable finished audiovisual product. 
These problems are exacerbated where the audiovisual 
product has a complex navigational structure or requires 
many separate raw content objects. 

20 

As a simple example, a feature movie or television 
program typically has a straightforward linear 
navigational sequence of individual scenes. By contrast, 
it is now desired to develop new categories of audiovisual 
25 products which have a much more complex navigational 
structure, such as a movie with many scene choices or 
different movie endings, and/or which have a large number 
of individual scenes, such as an interactive quiz game 
with say one thousand individual quiz questions. 

30 

An optical disc is a convenient storage media for 
many different purposes. A digital versatile disc (DVD) 
has been developed with a capacity of up to 4.7Gb on a 
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single- sided single- layer disc, and up to 17Gb on a 
double-sided double- layer disc. There are presently 
several different formats for recording data onto a DVD 
disc, including DVD-video, DVD-audio, and DVD RAM, amongst 
5 others. Of these, DVD-video is particularly intended for 
use with pre-recorded video content, such as a motion 
picture. As a result of the large storage capacity and 
ease of use, DVD discs are becoming popular and 
commercially important. Conveniently, a DVD-video disc is 

10 played using a dedicated playback device with relatively 
simple user controls, and DVD players for playing DVD- 
video discs are becoming relatively widespread. More 
detailed background information concerning the DVD-video 
specification is available from DVD Forum at 

15 www . dvdf orum . org . 

Although DVD-video discs and DVD-video players are 
becoming popular and widespread, at present only a limited 
range of content has been developed. In particular, a 

2 0 problem arises in that, although the DVD specification is 
very flexible, it is also very complex. The process of 
authoring content into a DVD-video compatible format is 
relatively expensive and time consuming. In practice, the 
flexibility and functions allowed in the DVD-video 

25 specification are compromised by the expensive and time 
consuming authoring task. Consequently, current DVD-video 
discs are relatively simple in their navigational 
complexity. Such simplicity can impede a user's enjoyment 
of a DVD- video disc, and also inhibits the development of 

30 new categories of DVD-video products. 

An example DVD authoring tool is disclosed in 
WO 99/38098 (Spruce Technologies) which provides an 
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interactive graphical authoring interface and data 
management engine. This known authoring tool requires a 
relatively knowledgeable and experienced operator and 
encounters difficulties when attempting to develop an 
5 audiovisual product having a complex navigational 
structure. In particular, despite providing a graphical 
user interface, the navigational structure of the desired 
DVD-video product must be explicitly defined by the 
author. Hence, creating a DVD- video product with a complex 
10 navigational structure is expensive, time-consuming and 
error -prone. 

Furthermore, there are typically three types of 
testing that are undertaking to test DVD products. These 

15 three types of testing aim to test (1) functionality, (2) 
quality and (3) compatibility. The functionality testing 
of a DVD product aims to confirm that the navigation paths 
through the various menus and, ultimately, to the various 
digital content, is as intended. This test is typically 

20 achieved by a person using the disc and performing a 
number of tests and checks dictated by, for example, a 
functionality test plan. The functionality test plan 
comprises a list of features or actions that a user of a 
disc under test should be able to perform. The test plan 

25 investigates whether or not various tests have been met 
and whether or not the response to various actions were as 
anticipated. The functionality test plan might be used in 
conjunction with a flowchart that shows the navigation 
paths through the menus and various audiovisual assets 

30 stored on the test disc. 

It will be appreciated that this is a labour 
intensive and time-consuming process. As the navigation 
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complexity of the content of a DVD increases and as the 
number of assets used by the navigation structure or 
navigation process increases, it becomes impractical to 
test every possible navigation path. Therefore, a tester 
5 usually concentrates on a statistically significant subset 
of all possible navigation paths of the disc in 
determining whether or not the disc meets the test plan. 
However, using a small sample or test space to decide 
whether or not a disc operates as intended is risky in 
10 that errors might still exist in some untested portions of 
the content. 

It is an object of embodiment of the present invention at 
least to mitigate some of the problems of the prior art. 

15 

Summary of Invention 

In a first aspect of the present invention there is 
provided an authoring method for use in creating an 

20 audiovisual product, comprising the steps of: defining a 
plurality of components, the components implicitly 
representing functional sections of audiovisual content 
with respect to one or more raw content objects, and a 
plurality of transitions that represent movements between 

25 the plurality of components; expanding the plurality of 
components and the plurality of transitions to provide a 
set of explicitly realised AV assets and an expanded 
intermediate data structure of nodes and links, where each 
node is associated with an AV asset of the set and the 

30 links represent movement from one node to another; 
creating an audiovisual product in a predetermined output 
format, using the AV assets and the expanded intermediate 
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data structure of the nodes and the links; and testing the 
audiovisual product . 

In one preferred embodiment, the present invention 
5 relates to authoring of audiovisual content into a form 
compliant with a specification for DVD-video and able to 
be recorded on an optical disc recording medium. 

In a second aspect of the present invention there is 
10 provided an authoring method for use in creating a DVD- 
video product, comprising the steps of: creating a 
plurality of components representing parameterised 
sections of audiovisual content, and a plurality of 
transitions representing movements between components; 
15 expanding the plurality of components and the plurality of 
transitions to provide a set of AV assets and an expanded 
data structure of nodes and links, where each node is 
associated with an AV asset of the set and the links 
represent movement from one node to another; creating a 
20 DVD-video format data structure from the AV assets, using 
the nodes and links; and testing the DVD-video format data 
structure . 

In a third aspect of the present invention there is 
25 provided an authoring method for use in creating an 
audiovisual product according to a DVD-video 
specification, comprising the steps of: generating a set 
of AV assets each comprising a video object, zero or more 
audio objects and zero or more sub-picture objects, and an 
30 expanded data structure of nodes and links, where each 
node is associated with one AV asset of the set and the 
links represent navigational movement from one node to 
another; and creating a DVD- video format data structure 



6 



from the set of AV assets, using the nodes and links; the 
method characterised by the steps of: creating a plurality 
of components and a plurality of transitions, where a 
component implicitly defines a plurality of AV assets by 
5 referring to a presentation template and to items of raw 
content substitutable in the presentation template, and 
the plurality of transitions represent navigational 
movements between components; expanding the plurality of 
components and the plurality of transitions to generate 
10 the set of AV assets and the expanded data structure of 
nodes and links; and testing the set of AV assets and the 
expanded data structure of nodes and links. 

In another aspect the present invention there is 
15 provided a recording medium having recorded thereon 
computer implementable instructions for performing any of 
the methods defined herein. 

In yet another aspect of the present invention there 
2 0 is provided a recording medium having recorded thereon an 
audiovisual product authored according to any of the 
methods defined herein. 

Advantageously, embodiments can provide a convenient and 
25 simple method and apparatus for authoring an audio-visual 
product . 

Preferred embodiments provide a method and apparatus 
able to create an audio-visual product having a complex 
30 navigational structure and/or having many individual 
content objects, whilst reducing a time required for 
authoring and minimising a need for highly skilled 
operators . 
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Preferably, there is provided an authoring tool which 
is intuitive to use and is highly flexible. 

5 Particularly preferred embodiments support creation 

of audio-visual products such as DVD-video products that 
run on commonly available DVD-video players. 

Accordingly, a first aspect of embodiments of the 
10 present invention provides a data processing system 
comprising a controller for processing a data stream 
comprising data representing at least one of a first video 
sequence (digitised video data) having associated 
identification data (unique identifier embedded in the 
15 user_data field) and associated navigation data; means 
(identifier extractor) to identify the associated 
identification data; a correlator (Navigation enumerator 
and identifier index) to correlate the identification data 
with a template (test plan) comprising data representing 
20 an abstraction of the first video sequence and the 
navigation data to determine whether or not there is a 
predetermined correlation, expressed in the template, 
between the data stream, or first video sequence, and the 
data contained within the template. 

25 Advantageously, embodiments of the present invention allow 
at least the functionality of, for example, a DVD or DVD- 
video image data to be tested. It will be appreciated 
that this might allow significant savings to be made both 
in terms of time spent testing and labour charges 

30 associated with that testing. Furthermore, it also 
carries the additional possible benefit of DVD's being 
tested more thoroughly, which should, in turn, ensure that 
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the user's experience of that DVD is not impaired by any 
errors . 

Brief Description of the Drawings 

5 

Embodiments of the present invention will now be 
descried, by way of example only, with reference to the 
accompanying drawings in which: 

Figure 1 is an overview of an authoring method 
10 according to a preferred embodiment; 

Figure 2 is a schematic diagram showing a simple 
abstraction of a desired audiovisual product; 

Figure 3 shows in more detail a component used as part 
of the abstraction of Figure 2; 
15 Figure 4 illustrates an example prior art authoring 

method compared with an example preferred embodiment; 

Figure 5 depicts another example embodiment of the 
present authoring method using components and transitions; 
Figure 6 shows the example of Figure 5 in a tabular 
2 0 format; 

Figure 7 is an overview of a method for evaluating 
components and transitions; 

Figure 8 depicts evaluation of components in more 
detail ; 

25 Figure 9 shows evaluation of transitions in more 

detail ; 

Figure 10 illustrates a portion of an expanded data 
structure during evaluation of components and transitions; 

Figure 11 is an overview of a preferred method for 
30 creating DVD- video structures from an expanded data 
structure; 

Figure 12 shows a step of creating DVD video structure 
locations in more detail; 
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Figure 13 depicts a step of creating DVD-video 
compatible data structures in more detail; and 

Figure 14 shows, schematically, a typical home 
entertainment system comprising a DVD player, a DVD and a 
5 television; 

Figure 15 illustrates a first embodiment at least 
part of the present invention; and 

Figure 16 shows a first aspect of testing a DVD 
according to an embodiment. 

10 

Detailed Description of the Preferred Embodiments 

Figure 1 shows an overview of an authoring method 
15 according to a preferred embodiment of the present 
invention. The embodiments of the present invention are 
applicable when authoring many types of audiovisual 
content or products, and in particular when complex 
navigational structure or content are involved. 

20 

As one example, embodiments of the present invention 
are applicable to authoring of video -on -demand products 
delivered remotely from a service provider to a user, such 
as over a computer network or other telecommunications 
25 network. Here, the embodiments of present invention are 
especially useful in authoring interactive products, where 
user choices and responses during playback of the product 
dictate navigational flow or content choices. 

3 0 As another example, embodiments of the present 

invention are particularly suitable for use in the 
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authoring of an audiovisual product or audio visual 
content compliant with a DVD-video specification. This 
example will be discussed in more detail below in order to 
illustrate the preferred arrangements of present 
5 invention. The audiovisual product can be, for example, 
recorded onto a medium such as an optical disk or magnetic 
medium. The DVD- video specification defines a series of 
data objects that are arranged in a hierarchical 
structure, with strict limits on the maximum number of 

10 objects that exist at each level of the hierarchy. Hence, 
in one preferred embodiment of the present invention it is 
desired to create an audiovisual product or audiovisual 
content which meets these and other limitations of the 
specification. In particular it is desired that the 

15 resultant audiovisual product will play on commonly 
available DVD players. However, it is also desired to 
create the audiovisual product having a complex 
navigational structure, to increase a user's enjoyment of 
the product, and in order to allow the creation of new 

20 categories of audiovisual products. 

In the field of DVD- video, audiovisual content is 
considered in terms of audio-visual assets (also called AV 
assets or presentation objects) . According to the DVD- 

25 video specification each AV asset contains at least one 
video object, zero or more audio objects, and zero or more 
sub-picture objects. That is, a section of video data is 
presented along with synchronised audio tracks and 
optional sub-picture objects. The current DVD-video 

30 specification allows up to eight different audio tracks 
(audio streams) to be provided in association with up to 
nine video objects (video streams) . Typically, the video 
streams represent different camera angles, whilst the 
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audio streams represent different language versions of a 
soundtrack such as English, French, Arabic etc. Usually, 
only one of the available video and audio streams is 
selected and reproduced when the DVD- video product is 
5 played back. Similarly, the current specification allows 
up to thirty- two sub-picture streams, which are used for 
functions such as such as language subtitles. Again, 
typically only one of the sub-picture streams is selected 
and played back to give, for example, a movie video clip 

10 with English subtitles from the sub-picture stream 
reproduced in combination with a French audio stream. Even 
this relatively simple combination of video, audio and 
sub-picture streams requires a high degree of co- 
ordination and effort during authoring to achieve a 

15 finished product such as a feature movie. Hence, due to 
the laborious and expensive nature of the authoring 
process there is a strong disincentive that inhibits the 
development of high-quality audiovisual products or 
content according to the DVD- video specification. There is 

2 0 then an even stronger impediment against the development 
of audiovisual products or content with complex 
navigational flow or using high numbers of individual raw 
content ob j ects . 

25 Conveniently, the authoring methods of embodiments of 

the present invention are implemented as a program or a 
suite of programs . The program or programs are recorded or 
stored on or in any suitable medium, including a removable 
storage such as a magnetic disk, hard disk or solid state 

30 memory card, or as a signal modulated onto a carrier for 
transmission on any suitable data network, such as the 
Internet . 
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In use, the authoring method is suitably performed on 
a computing platform, like a general -purpose computing 
platform such as a personal computer or a client -server 
computing network. Alternatively, the method may be 
5 implemented, wholly or at least in part, by dedicated 
authoring hardware. 

As shown in Figure 1, the authoring method of the 
preferred embodiment of the present invention comprises 

10 three main stages, namely: creating a high-level 
abstraction (or storyboard) representing functional 
sections of a desired audiovisual product in step 101; 
automatically evaluating the high-level abstraction to 
create a fully expanded intermediate structure and a set 

15 of AV assets in step 102; and creating an output data 
structure compliant with a DVD-video specification using 
the expanded intermediate structure and AV assets in step 
103. Preferably, the output data structure can then 
recorded onto a recording medium, such as, for example, a 

20 digital linear tape that can be used, to create a DVD- 
video product using glass master created using the content 
of the digital linear tape. 

The method outlined in Figure 1 will now be explained 
25 in more detail. 

Firstly, looking at the step 101 of Figure 1, the 
high-level abstraction is created by forming a plurality 
of components that implicitly represent functional 
30 elements of a desired DVD-video product, and a set of 
transitions that represent movements, that is, navigation, 
between the components that will occur during playback. 
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Figure 2 is a schematic diagram showing a simple 
abstraction of a desired audiovisual product. In the 
example of Figure 2 there are three components 201, linked 
by two transitions 202. The components 201 represent 
5 functional elements of the desired audiovisual product, 
where one or more portions of AV content (combinations of 
video clips, audio clips, etc) are to be reproduced during 
playback. The transitions 202 indicate legitimate ways of 
moving from one component to another during playback. In 

10 the example of Figure 2, the transitions 202 are all 
explicitly defined. Suitably, each transition 202 is 
associated with an event 203, which indicates the 
circumstances giving rise to that transition. An event 
203 is a triggering action such as the receipt of a user 

15 command, or the expiry of a timer, that influences 
movement through the sections of AV content during 
playback. Referring to Figure 2, starting from a 
particular component A, and given all possible actions, 
exactly one event 203 will be satisfied, allowing a 

20 transition 2 02 from the current component A to a next 
component B or C. 

The preferred embodiments provide three different 
types of component. These are an information component, a 
25 choice component and a meta- component . 

An information component represents what will in due 
course become a single AV asset in the desired audiovisual 
product. Suitably, an information component simply 
30 comprises a reference to a raw content object or 
collection of raw content objects (i.e. raw video and 
audio clips, image stills or other digital content) that 
will be used to create an AV asset in the audiovisual 
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product. For example, an information component refers to 
a welcome sequence that is displayed when the DVD-video 
product is played in a DVD-video player. The same welcome 
sequence is to be played each time playback begins. It is 
5 desired to display the welcome sequence, and then proceed 
to the next component. An information component (which 
can also be termed a simple component) is used principally 
to define presentation data in the desired DVD-video 
product . 

10 

A choice component represents what will become a 
plurality of AV assets in the desired audiovisual product. 
In the preferred embodiment, the choice component 
(alternately termed a mult i- component ) comprises a 

15 reference to at least one raw content object, and one or 
more parameters. Here, for example, it is desired to 
present a welcome sequence in one of a plurality of 
languages, dependent upon a language parameter. That is, 
both a speaker's picture (video stream) and voice track 

20 (audio stream) are changed according to the desired 
playback language. Conveniently, a choice component is 
used to represent a set of desired AV assets in the 
eventual audiovisual product, where a value of one or more 
parameters is used to distinguish between each member of 

25 the set. Hence, a choice component represents mainly 
presentation data in a desired DVD-video product, but also 
represents some navigational structure (i.e. selecting 
amongst different available AV assets according to a 
language playback parameter) . 

30 

A meta-component comprises a procedurally-def ined 
structure representing a set of information components 
and/or a set of choice components, and associated 
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transitions. Conveniently, a met a -component may itself 
define subsidiary meta- components . A meta- component is 
used principally to define navigational structure in the 
desired audiovisual product by representing other 
5 components and transitions. 

Figure 3 shows a choice component or information 
component 201 in more detail. The component is reached by 
following one of a set of incoming transitions 202, 
10 labelled Ti(Ln) , and is left by following one of a set of 
outgoing transitions To(l...m). The set of incoming 
transitions 2 02 might comprise one or more than one 
incoming transition. The set of outgoing transitions 
might comprise one or more than one outgoing transition. 

15 

The component 2 01 is defined with reference to zero or 
more parameters 3 01, which are used only during the 
authoring process. However, the component 201 may also be 
defined with reference to zero or more runtime variables 

20 302. Each variable 302 records state information that can 
be read and modified within the scope of each component, 
during playback of the audiovisual product such as in a 
standard DVD player. Conveniently, the component 2 01 is 
provided with a label 303 for ease of handling during the 

25 authoring process. 

The component 201 contains references to one or more 
items of content 3 04. The items of content are raw 
multi-media objects (still picture images, video clips, 
30 audio clips, text data, etc.) recorded in one or more 
source storage systems such as a file system, database, 
content management system, or asset management system, in 
any suitable format such as, for example, .gif, .tif, 
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.bmp, .txt, .rtf, .jpg, .mpg, .qtf, .mov, .wav, .rm, .qtx, 
amongst many others. It will be appreciated that these raw 
content objects are not necessarily at this stage in a 
format suitable for use in the DVD-video specification, 
5 which demands that video, audio and sub-picture objects 
are provided in selected predetermined formats (i.e. 
MPEG) . 

Each component 201 uses the references as a key or 
10 index that allows that item of content to be retrieved 
from the source storage systems. The references may be 
explicit (e.g. an explicit file path), or may be 
determined implicitly, such as with reference to values of 
the parameters 3 01 and/or variables 3 02 (i.e. using the 
15 parameters 3 01 and/or variables 3 02 to construct an 
explicit file path) . 

Conveniently, the component 201 also preferably 
comprises a reference to a template 305. The template 3 05 

20 provides, for example, a definition of presentation, 
layout, and format of a desired section of AV content to 
be displayed on screen during playback. A template 305 
draws on one or more items of content 3 04 to populate the 
template. Typically, one template 305 is provided for 

25 each component 201. However, a single template 305 may be 
shared between a number of components 2 01 or vice versa. 
A template 305 is provided in any suitable form, such as, 
for example, as an executable program, a plug- in or an 
active object. A template is conveniently created using a 

30 programming language such as C++, Visual Basic, Shockwave 
or Flash, or by using a script such as HTML or Python, 
amongst many others. Hence, it will be appreciated that a 
template allows a high degree of flexibility in the 
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creation of AV assets for a DVD-video product. Also, 
templates already created for other products (such as a 
website) may be reused directly in the creation of another 
form of audiovisual product, in this case a DVD-video 
5 product content . 

The parameters 3 01, runtime variables 3 02, content 
items 304 and template 3 05 together allow one or more AV 
assets to be produced for use in the desired audiovisual 
10 product. Advantageously, creating a component 201 in this 
parameterised form allows a number, which might be a large 
number, large plurality of AV assets to be represented 
simply and easily by a single component. 

15 To illustrate the power and advantages of creating 

components 201 and transitions 202 as described above, 
reference will now be made to Figure 4 which compares a 
typical prior art method for authoring an audiovisual 
product against preferred embodiments of the present 

20 invention. In this example, it is desired to develop an 
audiovisual product that allows the user to play a simple 
quiz game. 

In Figure 4a, each AV asset 401 that it is desired to 
25 present in the eventual audiovisual product must be 
created in advance and navigation between the assets 
defined using navigation links represented by arrows 402. 
Here, the game involves answering a first question and, if 
answered correctly, then answering a second question. The 
30 answer to each question is randomised at runtime using a 
runtime variable such that one of answers A, B and C is 
correct, whilst the other two are incorrect. In this 
simple example of Figure 4a it can be seen that a large 
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number of assets need to be created, with an even greater 
number of navigational links. Hence, the process is 
relatively expensive and time consuming, and is prone to 
errors . 

5 

Figure 4b shows an abstraction, using components and 
transitions as described herein, for an equivalent quiz 
game. It will be appreciated that the abstraction shown 
in Figure 4b remains identical even if the number of 
10 questions increases to ten, twenty, fifty or some other 
number of questions, whereas the representation in Figure 
4a becomes increasingly complex as each question is added. 

Figure 5 shows another example abstraction using 
15 components and transitions. Figure 5 illustrates an 
example abstraction for an audiovisual product that will 
contain a catalogue of goods sold by a retail merchant. A 
welcome sequence is provided as an information component 
2 01a. Choice components 201b are used to provide a set of 
20 similar sections of AV content such as summary pages of 
product information or v pages of detailed product 
information including photographs or moving video for each 
product in the catalogue. Here, the catalogue contains, 
for example, of the order of one thousand separate 
25 products, each of which will result in a separate AV asset 
in the desired DVD-video product. Met a- components 201c 
provide functions such as the selection of products by 
category, name or by part code. These met a- components are 
procedurally defined. 

30 

Figure 6 shows a tabular representation for the 
abstraction shown in schematic form in Figure 5. 
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In use, the authoring method and apparatus suitably 
presents a convenient user interface for creating 
components and transitions of the high-level abstraction. 
Ideally, a graphical user interface is provided allowing 
5 the definition of components, transitions and events, 
similar to the schematic diagram of Figure 5. Most 
conveniently, the user interface provides for the 
graphical creation of components such as by drawing boxes 
and entering details associated with those boxes, and 
10 defining transitions by drawing arrows between the boxes 
and associating events with those arrows. Alternatively, a 
tabular textual interface is provided similar to the table 
of Figure 6 . 

15 Referring again to Figure 1, the abstraction created 

in step 101 is itself a useful output. The created 
abstraction may be stored for later use or may be 
transferred to another party for further work. However, in 
most cases the authoring method is used to automatically 

20 create a final audiovisual product, such as a DVD-video 
product, from the abstraction. 

Referring to Figure 1, the method optionally includes 
the step 104 of checking for compliance with a DVD 

25 specification. It is desired to predict whether the 
resulting DVD-video product will conform to a desired 
output specification, in this case the DVD-video 
specification. For example, the DVD-video specification 
has a hierarchical structure with strict limits on a 

30 maximum number of objects that may exist at each level, 
and limits on the maximum quantity of data that can be 
stored on a DVD-video disc. 
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In one embodiment, the checking step 104 is performed 
using the created components 201 and transitions 202. As 
discussed above, the components 201 contain references to 
raw AV content objects 3 04 and templates 305, and 
5 authoring parameters 301, 302, that allow AV assets to be 
produced. The checking step 104 comprises predicting a 
required number of objects at each level of the 
hierarchical structure, by considering the number of 
potential AV assets that will be produced given the 

10 possible values of the authoring parameters (i.e. 
authoring-only parameters 3 01 and runtime variables 3 02) , 
and providing an indication of whether the limits for the 
maximum number of objects will be exceeded. Similarly, 
where a component defines a set of similar AV assets, then 

15 it is useful to predict the physical size of those assets 
and to check that the audiovisual product is expected to 
fit within the available capacity of a DVD disc. 
Advantageously, the conformance check of step 104 is 
performed without a detailed realisation of every AV 

20 asset, whilst providing an operator with a reasonably 
accurate prediction of expected conformance. If 
non- conformance is predicted, the operator may then take 
steps, at this early stage, to remedy the situation. As a 
result, it is possible to avoid unnecessary time and 

25 expense in the preparation of a full audiovisual product 
which is non-conf ormant . 

As shown in Figure 1, in step 102 the components 201 
and transitions 202 of the high level abstraction 200 are 
3 0 automatically evaluated and expanded to create AV assets 
and an intermediate data structure of nodes and links. 
Figure 7 shows the step 102 of Figure 1 in more detail. 
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The components 201 and transitions 202 may be 
evaluated in any order. However, but it is convenient to 
first evaluate the components and then to evaluate the 
transitions. Ideally, any meta- components in the 

5 abstraction are evaluated first. Where a meta -component 
results in new components and transitions, these are added 
to the abstraction until all meta- components have been 
evaluated, leaving only information components and 
parameterised choice components. 

10 

An expanded intermediate data structure is created to 
represent the abstract components 2 01 and transitions 2 02 
in the new evaluated form. This expanded data structure 
comprises branching logic derived from the events 2 03 

15 attached to the transitions 202 (which will eventually 
become navigation data in the desired audiovisual product) 
and nodes associated with AV assets derived from the 
components 201 (which will eventually become presentation 
data in the audiovisual product) . However, it is not 

20 intended that the expanded data structure is yet in a 
suitable form for creating an audiovisual product in a 
restricted format such as a DVD-video product, since at 
this stage there is no mapping onto the hierarchical 
structure and other limitations of the DVD-video 

25 specification. 

Figure 8 shows step 701 of Figure 7 in more detail, to 
explain the preferred method for evaluating the components 
201. As shown in Figure 8, each information component 201a 
30 and each choice component 201b is selected in turn in step 
801. Each component 201 is evaluated to provide one or 
more AV assets in step 802. In an information component, 
this evaluation comprises creating an AV asset from the 
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referenced raw content objects 304. In a choice component, 
this evaluation step comprises evaluating a template 305 
and one or more raw content objects 304 according to the 
authoring parameters 301/3 02 to provide a set of AV 
5 assets. Suitably, a node in the expanded data structure 
is created to represent each AV asset, at step 803. At 
step 804, entry logic and/or exit logic is created to 
represent a link to or from each node such that each AV 
asset is reached or left under appropriate runtime 
10 conditions. 

Figure 9 shows a preferred method for evaluating 
transitions in step 702 of Fig. 7. Each transition 202 is 
selected in any suitable order in step 901. In step 902 
15 the conditions of the triggering event 203 associated with 
a particular transition 202 are used to create entry 
and/or exit logic for each node of the expanded data 
structure. In step 903, explicit links are provided 
between the nodes. 

20 

Figure 10 is a schematic illustration of a component 
201 during evaluation to create a set of nodes 110 each 
associated with an AV asset 120, together with entry logic 
132 and exit logic 134, defining movement between one node 

25 110 and the next. The entry logic 132 and exit logic 134 
reference runtime variables 3 02 which are available during 
playback (e.g. timer events, player status, and playback 
states), and the receipt of user commands. Conveniently, 
the evaluation step consumes each of the authoring -only 

30 parameters 301 associated with the abstract components 
201, such that only the runtime variables 3 02 and runtime 
actions such as timer events and user commands remain. 
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Referring again to Figure 1, a conformance checking 
step 105 may, additionally or alternatively to the 
checking step 104, be applied following the evaluation 
step 102. Evaluation of the abstraction in step 102 to 
5 produce the expanded data structure 100 allows a more 
accurate prediction of expected compliance with a 
particular output specification. In particular, each node 
of the expanded data structure represents one AV asset, 
such that the total number of AV assets and object 

10 locations can be accurately predicted, and the set of AV 
assets has been created, allowing an accurate prediction 
of the capacity required to hold these assets. 
Conveniently, information about conformance or non- 
conformance is fed back to an operator. Changes to the 

15 structure of the product can then be suggested and made in 
the abstraction to improve compliance. 

Referring to Figure 1, in step 103 the expanded data 
structure from step 102 is used to create an audiovisual 
20 product according to a predetermined output format, in 
this case by creating specific structures according to a 
desired DVD-video specification. 

Figure 11 shows an example method for creation of the 
25 DVD video structures. In step 1101, the nodes 110 in the 
expanded data structure are placed in a list, such as in 
an order of the abstract components 2 01 from which those 
nodes originated, and in order of the proximity of those 
components to adjacent components in the abstraction. As 
30 a result, jumps between DVD video structure locations 
during playback are minimised and localised to improve 
playback speed and cohesion. 
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Each node is used to create a DVD video structure 
location at step 1102. Optionally, at step 1103 if the 
number of created DVD video structure locations exceeds 
the specified limit set by the DVD-video specification 
5 then creation is stopped at 1104 and an error reported. 
Assuming the number of structures is within the specified 
limit then DVD video compatible data structures are 
created at step 1105. Finally, a DVD-video disc image is 
created at step 1106. Conveniently, commercially 

10 available tools are used to perform step 1106 and need not 
be described in detail here. 

Step 1102 is illustrated in more detail in Figure 12. 
In this example variable T represents a number of a video 

15 title set VTS (ie. from 1-99) whilst variable P represents 
a program chain PGC (ie. from 1-999) within each video 
title set. As shown in Figure 12, the nodes 110 of the 
expanded data structure 100 are used to define locations 
in the video title sets and program chains. As the 

20 available program chains within each video title set are 
consumed, then the locations move to the next video title 
set. Here, many alternate methods are available in order 
to optimise allocation of physical locations to the nodes 
of the expanded data structure. 

25 

Step 1105 of Figure 11 is illustrated in more detail 
in Figure 13 . Figure 13 shows a preferred method for 
creating DVD-video compatible data structures by placing 
the AV assets 120 associated with each node 110 in the 
30 structure location assigned for that node and substituting 
links between the nodes with explicit references to 
destination locations. At step 1307 this results in an 
explicit DVD compatible data structure which may then be 
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used to create a DVD disc image. Finally, the DVD disc 
image is used to record a DVD disc as a new audiovisual 
product . 

5 Figure 14 shows, schematically, a typical home 

entertainment system 1400 comprising a DVD player 1402, a 
DVD 1404 and a television 1406. The DVD 1404 comprises 
presentation data 1408 and navigation data 1410. The 
navigation data 1410 is used by a navigation engine 1412 

10 within the DVD player 1402 to control the order or manner 
of presentation of the presentation data 1408 by a 
presentation engine 1414. The presentation engine 1414 
presents the presentation data 1408 on the television 1406 
as rendered audiovisual content 1416. As is well known 

15 within the art, the rendered audiovisual content 1416, 
conventionally, takes the form of a movie or photographic 
stills or text associated with that movie. It will be 
appreciated that a navigation manager represents, or 
represents at least part of, an embodiment or a navigation 

20 engine or controller. Similarly, a presentation engine 
represents an embodiment of at least part of a 
presentation engine or controller. 

The presentation data and navigation data, that is, the 
DVD- video disc image data, comprises audiovisual content 

25 that is derived from raw content objects, which include 
audio content and visual content, and structured according 
to a navigation plan that reflects desired transitions and 
relationships between the parts of the audiovisual content 
or the raw content objects used to produce the audiovisual 

30 content. Within an authoring tool, the raw content 
objects are represents by respective abstractions that are 
typically icons. It will be appreciated that, for 
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example, such abstractions can be a "scenario" that is 
produced by the Scenarist product available from Sonic 
Solutions . 

A user (not shown) can use a remote control 1418 
5 associated with the DVD player 1402 to influence the 
operation of the navigation engine 1412 via an infrared 
remote control interface 1420. The combination of the 
infrared remote control 142 0 and the navigation engine 
1412 allows the user to make various selections from any 
10 menus presented by the presentation engine 1414 under 
control of the navigation engine 1412 as mentioned above. 

Referring to figure 15, there is shown a testing 
arrangement 1500 using an embodiment of the present 
invention. Figure 15 shows a DVD disc 15 02 storing 

15 presentation data 1504 and navigation data 1506. The DVD 
player 1508 comprises a respective presentation engine 
1510 and navigation engine 1512. In preferred 

embodiments, the DVD player 1508 is a software player, 
that is, it is executable by a computer such as, for 

20 example, a desk- top PC or other computer. 

It will be appreciated that the presentation data 
1504 comprises a number of audiovisual assets (not shown) . 
The video assets are encoded during the authoring process 
to have an associated unique identifier. Alternatively, 

25 only selected video assets might be encoded with such an 
associated unique identifier. For example, when encoding 
video data, that is, a video sequence, to produce a 
corresponding MPEG video stream, the unique identifier 
might be placed in the user_data field of the MPEG video 

30 stream as defined by the MPEG-2 standard, which is 
incorporated herein by reference for all purposes. The 
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unique identifier allows the associated video asset to be 
identified. In a preferred embodiment, the presentation 
engine 1510 processed the presentation data stream 1514 
using an identifier extractor 1516. The identifier 
5 extractor 1516 extracts the data representing the unique 
identifier from the user_data field of the MPEG elementary 
video stream 1514 and forwards the unique identifier to a 
navigation enumerator 1518. 

In preferred embodiments, the unique identifiers are 
10 embedded within the MPEG streams during authoring. This 
has the advantage that an association can be created more 
readily between a unique identifier and the abstraction 
representing the raw content or raw content object from 
which the MPEG stream is derived. Alternatively, or 
15 additionally, prior to testing audiovisual content, the 
content can be traversed to assign unique identifiers to 
each, or selected, MPEG streams, which will allow the 
navigation through that content to be tracked using the 
unique identifiers . 

20 The navigation enumerator 1518, in effect, replaces 

the infrared remote control 1418 mentioned above. The 
navigation enumerator 1518 generates control signals that 
influence the operation of the navigation engine 1512 in 
substantially the manner as the infrared signals influence 

25 the operation of the navigation engine 1512. The 
navigation enumerator 1518 is responsive to a 
functionality test plan 1540. The functionality test plan 
1540 comprises a high level abstraction of the data 
anticipated to be contained on the disc. The test plan 

30 contains an expectation of the paths through the data 
contained on the disc together with a high-level 
abstraction of the elements anticipated as representing 
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that data. In preferred embodiments, the test plan might 
comprise at least one of a start point, which can be 
defined in terms of initialisation data for initialising 
the DVD player's registers, for example, an indication of 
5 anticipated events or outputs expected to be produced by 
the player, unique identifiers associated with those 
events or outputs and commands that are intended to 
simulate menu selections or button commands, that is, user 
input actions. The navigation enumerator 1518 comprises a 

10 copy of each identifier incorporated into the presentation 
data 1504 together with respective references to high 
level abstractions of the assets associated with the 
unique identifiers. In preferred embodiments, the high 
level abstractions or data structures that correspond to 

15 the various assets forming the presentation data 1504 are 
stored on an HDD 1524. Upon receiving a unique identifier 
from the identifier extractor 1516, the navigation 
enumerator 1518 uses that identifier to obtain a reference 
to the high level abstraction corresponding to the unique 

20 identifier via the identifier index 1522. The high level 
abstraction associated with the unique identifier is 
obtained, using the reference, from the high level 
abstractions or data structures stored on the HDD 1544. 
The retrieved high level abstraction or data structures 

25 are compared with high level abstraction or data 
structures forming part of the test plan 154 0 to determine 
with there is a match or correlation between them 
according to a current position within the test plan. 
Alternatively, the extracted unique identifier is compared 

3 0 to an anticipated unique identifier to determine whether 
or not the content is being retrieved and processed as 
anticipated. The current position within the test plan is 
maintained or managed by the navigation enumerator. The 
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current position within the test plan 1540 corresponds to 
the next high-level data abstraction anticipated to match 
the next unique identifier, and, consequently, the next 
video sequence, retrieved from the presentation data 
5 stream 1514. If there is a match or correlation between 
the two high-level abstractions, the navigation enumerator 
creates a record to that effect. If there is not a match 
or correlation between the two high-level data 
abstractions, the navigation enumerator creates a record 

10 to that effect. In preferred embodiments the record 
contains an indication of the unique identifier together 
with an indication of the high-level abstraction 
associated with that identifier and the high-level 
abstraction anticipated as being identified by the test 

15 plan. The records are stored in a respective file 1534 
created by the navigation enumerator. Alternatively, or 
additionally, the record might comprise visual information 
of what was expected and what was actually produced. For 
example, screen shots or video sequences of the actual 

20 output of the presentation engine might be stored within 
the record. Optionally, the anticipated screen shots or 
video sequences might also be stored within the record. 

A register modifier 1526, forming part of the DVD 
player 1508, is used to read and/or modify the settings of 

25 the GPRMs and SPRMs of the DVD player 1508. The register 
modifier 1526 is operated under the control of the 
navigation enumerator 1518 to cause the navigation engine 
to access and give effect to the navigation data 1506 in a 
pre -determined manner or according to the requirements of 

30 the test plan 1540. In effect, the register modifier 1526 
controls the traversal of the disc 1502 or access to the 
assets stored on the disc 1502 to allow each, or selected, 
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navigation paths through the assets to be explored and 
associated audiovisual assets retrieved and rendered or 
processed to identify matches, or mismatches, between 
those assets with their anticipated high-level 
5 abstractions according to the test plan. 

Preferably, the embodiments also comprise a menu 
extractor 153 8. The menu extractor is used to intercept 
or process presentation data that identifies a current 
menu being processed. It will be appreciated that the 

10 presentation data can comprise menu data within or 
associated with an MPEG stream and that such an MPEG 
stream can have an associated unique identifier. 
Therefore, a unique identifier can also be used to 
identify a corresponding menu within the current 

15 presentation data stream. Hereafter, a unique identifier 
associated with a menu will be referred to as menu 
identification data. In preferred embodiments, the 

identifier index 1522 also contains a mapping between menu 
identification data and high-level abstraction data 

20 associated with such menu identification data. Again, the 
navigation enumerator 1518 uses the data output by the 
menu extractor 1538, in conjunction with the identifier 
index 1522 and the high-level abstraction data forming 
part stored on the HDD 1524, in a comparison with the test 

25 plan 1540 to determine whether the authored DVD is as 
anticipated. 

In preferred embodiments, the DVD player 1502 
comprises a manual navigation controller 1519 that 
presents an interface to a user (not shown) that can be 
30 used to influence the operation of the DVD player 1502. 
In preferred embodiments, the user interface of the manual 
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navigation controller is used to create the tests plans 
and/or to select between previously created test plans. 

Figure 16 shows a flowchart 16 00 for testing the 
functionality of a DVD according to an embodiment. At 
5 step 1602, the navigation enumerator is initialised with 
the disc's entry point or, in the general case, a desired 
entry point. It will be appreciated that using a desired 
entry point, rather than a disc's start entry point, has 
the advantage that functionally separate parts of the disc 

10 or content can be tested in isolation. This allows 
testing to be made more efficient, especially when options 
are encountered. Rather than testing all content 

preceding an option for every option at a particular 
decision point, the start point for the test can be the 

15 decision point, with the preceding content having been 
previously tested or assumed to be functionally correct. 
The initialisation establishes the point within the high 
level abstraction of the disc 1502 contained within the 
test plan 1540 at which the comparison between the content 

20 of the test disc 1502 and the anticipated content of that 
disc is commenced. It will be appreciated that when 
testing the complete disc, one skilled in the art might 
usually start from the discs initial entry point. The 
high-level abstractions stored on the HDD corresponding to 

25 the disc's entry point are retrieved by the navigation 
enumerator 1518 at step 1604. The unique identifier is 
read from the user_data field of the MPEG elementary video 
stream processed by the presentation engine 1510 in 
response to the navigation engine 1512 responding to the 

30 navigation enumerator's 1518 commands to obtain the first, 
or a current, MPEG elementary video stream. 
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At step 1608, the current menu being processed by the 
navigation engine 1512 is identified. The identifier 
index is accessed using the extracted unique identifier to 
identify, within the high-level abstractions stored on the 
5 HDD 1524, the corresponding abstraction corresponding to 
that unique identifier. It will be appreciated that the 
test might call for actuation of a button. Therefore, the 
navigation enumerator 218 simulates actuation of that 
button by providing appropriate signalling to the 
10 navigation engine. 

A comparison is performed, at step 1612, between the 
retrieved high-level abstraction corresponding to the 
unique identifier and an high-level abstraction 
anticipated as being encountered next by the test plan. A 

15 test is performed, at step 1614, to determine whether the 
currently processed, or output, video data or video 
signals are as anticipated, that is, it is determined 
whether or not there is a match between the high-level 
abstraction of the current assets and the anticipated 

20 high-level abstraction according to the test plan 1540. 
If the determination is positive, a record is written to 
the test results file 1534 providing an indication to that 
effect. A determination is made at step 1618 as to 
whether or not there are further test steps to be 

25 performed within a current test. If the determination at 
step 1618 is positive, processing proceeds from step 1606 
where the next MPEG elementary video stream is processed 
to extract its corresponding unique identifier. However, 
if the test at step 1618 is negative, testing of the DVD 

30 is deemed to be complete and processing terminates. If 
the test at 1614 is negative, a record is written to the 
test results file 1534 containing an indication to that 



33 



effect, where after processing proceeds from step 1618. 
It will be appreciated in practice that the storage of the 
test results and the tests or test plans will be achieved 
using the same HDD or the like. 

5 It will be appreciated that the steps of figure 16 

represent the execution or processing associated with a 
single test. Embodiments can be realised in which a test 
plan comprising multiple tests is executed. In such 
embodiments, the processing shown in figure 16 will be 
10 executed multiple times. 

Preferred embodiments of the present invention are 
realised in the form of a software DVD player that is 
modified to allow the presentation engine 1510 to extract 
an output the unique identifier contained within the 

15 user_data field of the MPEG elementary video stream. Such 
an embodiment is also modified to allow the navigation 
engine or navigation manager 1512 to output data 
identifying the current menu to allow the menu extractor 
153 8 to inform the navigation enumerator 1518 of the 

20 current menu. In preferred embodiments, the menu 

extractor 1538 forms part of the navigation engine 1512. 

Although the above embodiments use a unique identifier 
inserted into the user_data field of the MPEG elementary 
video stream as a reference, embodiments are not limited 

25 to such an arrangement. Embodiments can be realised in 
which, for example, the video stream has some other form 
of associated unique identifier data. For example, the 
MPEG elementary video stream might comprise a finger print 
that can be extracted by the identifier extractor and used 

3 0 as a reference to allow the navigation enumerator to 
correlate a current position on, or event associated with, 
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the data stored on the disc with the data structures 
stored on the disc with the data structures stored on the 
HDD. Alternatively, or additionally, the video 

represented by the MPEG elementary video stream might 
5 comprise "line 21" data. In effect, the "line 21" data 
comprises a unique identifier associated with each, or 
selectable, video sequences to be processed during 
authoring. 

10 The DVD authoring method and apparatus described above 

have a number of advantages. Creating components that 
represent parameterised sections of audio visual content 
allow many individual AV assets to be implicitly defined 
and then automatically created. Repetitive manual tasks 

15 are avoided, which were previously time consuming, 
expensive and error-prone. The authoring method and 
apparatus significantly enhance the range of features 
available in existing categories of audiovisual products 
or content such as movie presentations. They also allow 

20 new categories of audiovisual products or content to be 
produced. These new categories include both entertainment 
products or content such as quiz-based games and puzzle- 
based games, as well as information products such as 
catalogues, directories, reference guides, dictionaries 

25 and encyclopaedias. In each case, the authoring method 
and apparatus described herein allow full use of the video 
and audio capabilities of DVD specifications such as 
DVD-video. A user may achieve playback using a standard 
DVD player with ordinary controls such as a remote control 

30 device. A DVD-video product having highly complex 
navigational content is readily created in a manner that 
is simple, efficient, cost effective and reliable. 
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Although a few preferred embodiments have been shown 
and described, it will be appreciated by those skilled in 
the art that various changes and modifications might be 
made without departing from the scope of the invention, as 
5 defined in the appended claims. 

The term ''audiovisual product" comprises at least any 
one of data representing audiovisual content, DVD- video 
disc image data, data compliant with the DVD specification 
10 or a medium storing such data. 

Although the above embodiments have been described 
with reference to the product being playable by a 
"standard DVD player", it will be appreciated that other 
15 players can equally well be accommodated such as, for 
example, software players, set -top boxes or other means of 
processing or otherwise rendering audiovisual content 
using hardware or software or a combination of hardware 
and software. 

20 

The reader's attention is directed to all papers and 
documents which are filed concurrently with or previous to 
this specification in connection with this application and 
which are open to public inspection with this 
25 specification, and the contents of all such papers and 
documents are incorporated herein by reference. 

All of the features disclosed in this specification 
(including any accompanying claims, abstract and drawings) 
and/or all of the steps of any method or process so 
30 disclosed may be combined in any combination, except 
combinations where at least some of such features and/or 
steps are mutually exclusive. 
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Each feature disclosed in this specification 
(including any accompanying claims, abstract and drawings) 
may be replaced by alternative features serving the same, 
equivalent or similar purpose, unless expressly stated 
5 otherwise. Thus, unless expressly stated otherwise, each 
feature disclosed is one example only of a generic series 
of equivalent or similar features. 

The invention is not restricted to the details of any 
foregoing embodiments. The invention extends to any novel 
10 one, or any novel combination, of the features disclosed 
in this specification (including any accompanying claims, 
abstract and drawings), or to any novel one, or any novel 
combination, of the steps of any method or process so 
disclosed. 
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